Learning to Play Nash in Deterministic Uncoupled Dynamics
نویسندگان
چکیده
This paper is concerned with the following problem. In a bounded rational game where players cannot be as super-rational as in Kalai and Leher (1993), are there simple adaptive heuristics or rules that can be used in order to secure convergence to Nash equilibria, or convergence only to a larger set designated by correlated equilibria? Are there games with uncoupled deterministic dynamics in discrete time that converge to Nash equilibrium or not? Young (2008) argues that if an adaptive learning rule follows three conditions – (i) it is uncoupled, (ii) each player’s choice of action depends solely on the frequency distribution of past play, and (iii) each player’s choice of action, conditional on the state, is deterministic – no such rule leads the players’ behavior to converge to Nash equilibrium. In this paper we present a counterexample, showing that there are simple adaptive rules that secure convergence, in fact fast convergence, in a fully deterministic and uncoupled game. We used the Cournot model with nonlinear costs and incomplete information for this purpose and also illustrate that this convergence can be achieved with or without any coordination of the players actions.
منابع مشابه
Regret testing: learning to play Nash equilibrium without knowing you have an opponent
A learning rule is uncoupled if a player does not condition his strategy on the opponent’s payoffs. It is radically uncoupled if a player does not condition his strategy on the opponent’s actions or payoffs. We demonstrate a family of simple, radically uncoupled learning rules whose period-by-period behavior comes arbitrarily close to Nash equilibrium behavior in any finite two-person game.
متن کاملUncoupled Dynamics Do Not Lead to Nash Equilibrium
It is notoriously dif cult to formulate sensible adaptive dynamics that guarantee convergence to Nash equilibrium. In fact, short of variants of exhaustive search (deterministic or stochastic), there are no general results; of course, there are many important, interesting and well-studied particular cases. See the books of Jörgen W. Weibull (1995), Fernando VegaRedondo (1996), Larry Samuelson ...
متن کاملStochastic Uncoupled Dynamics and Nash Equilibrium ∗ ( Extended
In this paper we consider dynamic processes, in repeated games, that are subject to the natural informational restriction of uncoupledness. We study the almost sure convergence to Nash equilibria, and present a number of possibility and impossibility results. Basically, we show that if in addition to random moves some recall is introduced, then successful search procedures that are uncoupled ca...
متن کاملStochastic uncoupled dynamics and Nash equilibrium
In this paper we consider dynamic processes, in repeated games, that are subject to the natural informational restriction of uncoupledness. We study the almost sure convergence of play (the period-byperiod behavior as well as the long-run frequency) to Nash equilibria of the one-shot stage game, and present a number of possibility and impossibility results. Basically, we show that if in additio...
متن کاملRegret Testing: A Simple Payo¤-Based Procedure for Learning Nash Equilibrium1
A learning rule is uncoupled if a player does not condition his strategy on the opponents payo¤s. It is radically uncoupled if a player does not condition his strategy on the opponents actions or payo¤s. We demonstrate a family of simple, radically uncoupled learning rules whose period-by-period behavior comes arbitrarily close to Nash equilibrium behavior in any nite two-person game. Keywor...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2008